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ABSTRACT : PROBLEM TO BE SOLVED: To make It possible to display computer graphics of 
non-interlace display on a home TV in a high quality state. 

SOLUTION: Graphics data for plural lines including lines to be displayed are 
time-dividedly and alternately read out from a video memory 103, sent to a horizontal 
scaler 104b and successively applied to horizontal scaling processing. Horizontally scaled 
data on the same pixel position are vertically filtered by a vertical filter 104C in each data 
unit of plural lines. Since the horizontal scaling processing and the vertical filtering 
processing are executed like a pipeline, scaling processing and vertical filtering processing 
can be efficiently applied to graphics data read out from a video memory without using an 
off screen area in the memory 103. 
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h b'? ^/H£«0^— :?£WP7 A )V$ V yf&XXfX 
9-- 0 yfZti&m. ^rtL^y^y <r )i 9 V yf'teXV 

xy~ u yy^timmmmyA y^-fmzxmm 

?7f- ^ar \W%yA >'^C0^"5 7 -f 

7 iz3£wa-&mw.y 4iv?¥-®.t. t<7>mm.y 

-r i &SB:7 )V9 u yymmz X o# £>fi 

7^*7 7 fXiT-'-ftrnMA y?-u-X7^m<oM 
M-r'- * 2: £ f ? -fe; WiT'-^JjR-r S ^ 5 7 >f 7 7. ■ M 

[0019] ic7)«^fe^T{±. «7"i/yf^ y?i£ 
b'lzX h?yy 4? X.-T— ? t mw-r — h sob°7 -fe;k 
JWa^jas^'fcSfcioT: . *¥7 /u* u v^aiito 

/Ml i: , 7 'J -y ^l55±0^i6c7)Sfi7 ^ )V? V y 

mttw y°y A ymi / Exmfi£ti&» Ltztf^x. t 
vm^izmLtzm&wyy ^ rx^-tzmnT-? 
iz-sfc-fz, ztrfxz s m&wcoizmii&itTvizm^ 

[0020] ttc. z\<DW*mm\mmm : mm$. y 



^ )i <?m£tf3gm~*iffii,zm&-£ix, tr^x ^ u watt 

iz^-oxy 0 yy^titz^yy i 7Xf—?%;T 

vmcowmimi<zm%. LxTv^zm^thmim^m 

s I«I27 ^ u y<?mkv>y 4 Jl ? U 
iZfy 7 4 fx?-? h T7° U 7-- 3 y7°u 

fyj+frt,^ 4 j\s?w\mm%mzm®i.x . mm^ 

m^ay^y-Az^h-^xmm^zy j A^m±^wx 
[0021] ^iDam^^iffll^atfcwiTJi. 7 >r 

^ u >-^¥Pico7 4 )v* v y^m^^x^tzm-z 
mmmm^mmmz x -oxizmz i\%> x o izm^ttx 

Ltztfi-ox ^ mtif. ^m^co^bA *->>'m*cD 
ufttx-y jivwmzmmiz^m-fhzkttzxv)^ a 
yT-yvizmmLtzmm&y ^ jifw&t* ummznt 

[00221 4^ z <v?mi±. ff*^ ^ v iztmz 

ixtz^y 7 4 7 X-f — ? izicj LX 7 < )V9 o y^^mk 
m-y 4 iv? 'j yy^t . zcr>7 ^ )V? v yy^mz 
X~?xy 4 >v9vyy%ixtz-7'yy <t ?x7—?&tv 

mcommmtzm®, lttv tz&m-& vmmmm^ 
mt z^&wmm*mwmw.iz&^x . mmx j 

'J yy^m£ft£i*i / zmiEV7 £ **i=vcDyy7 4 7X 

7~?mmwim^m^mzmm-&tzbbcr>yAu 
[0023] zcDmmm^mm^m.iza^^x^. 7jjv 

? V yy^iA^^zmiWr^^V cory 7 a? 

it mimim^mm^mzmm- s tzvxoyA 
V9 v^xmm^Kxa, <o . zcn^Av-y y>^x*m 
m-t&zkizxK). 7 AJUfmffiZMLtzm^tmz* 

um^tlzWr)Wx&c\k&X'%&. Ltzt^X. miL 
fc£\ ^Mk^>^W±m^:t^z^X^"A \s? bJSXZ 

mmLxm^-t&ztizx*)^ 7 < )\s?®3&zm^&m 
^xr>hm^m.m^^xoc\k^x-%h. . 

[0024] 

mm&mzmw-t&. t-r. hii^»mlt. zcomz 

y f f >y 7°# y ^ X LTfigffl^il^ l> <?)Xfo K> . 

7 -f 7xtmmmtn&fmm%k*£mmmTvt l zm?ik 
i-'&mmzim-tz. zcomim^mmmmizit. 

cr>X5l,Z. DVD-ROMH7-i'710 1. MPEG2 
7*3— fl02. t'f^^y (VRAM) 103. * 
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5 _ y^ 7 H04a, X^-7l04b, 7f^7l 
04 c, a^lx^T-V ^"HISSl 0 5. NTSC1>3 

[0 0 2 5] DVD-ROM K5^1 0 111 3frr4 
X?*^DVD^fV710 0 § fut WW 

— f&xrfijfjy 4 fz&ttMayrrv ^i/myyu 

7 r -f ?&KAttJ-$-. 77 >J 7—v s >7n 

Lxmrnztiz^-cfo*)^ Z co 

y=y 7 4 7 7>-f - 7 t4tf — A a y b a— 7 OC P U J; 

ott'f^t'J (VRAM) 1 0 3tC*^3a^fL-&. 
[0026] SjBx-^^{4 . ( t'fjT ) , 16 

T-0#^ ( 4.* ) Z b 

h. £tf>*£\ £;ft.4>b*-r3j\ t7^fi-, 

<r *i4^*lwm peg 2£ts^r s^u-jEawf^ 

{tZtlTtm£ilX^&, MPEG2S« , «l MPE 

&&ZbtfZb tfTZ . h^m^ter-nt 1 #<DM 
P E G 2 7D^5A^ h u- A fc LT»*>*iS . tr-r* 
WflF^fctiiM P E G 2 SrftfflL. t7b?f^*3 it/ 

JzZf-D O L B Y AC 338*01113*14. ^CDif^T'ik. 

^tt t $ tr* . ^7 - b7x-*-. fcit**- 

■r-*:*tl l;*:c7)MPEG27'o7"7A7l- 'J-AfcL 

•ca*>*i4 , m p e g 2 mfawft^mmim&u- h 

ik^TtS* -fcoT. »*tf>akU^- 
>{5 fc\ •fft.fcfcrj&f £ 7 AffiPSrflWt"*-* MPEG 

[0 0 2 7] DVD^f'fTl 0 0?&»/i>K*ajSiTJfeM 
PEG27n7"5^h'J-i,(t MPEG2f3-/ 
1 0 2 fcil£>;ft.l>. MPEG2f3-n 0 2i4. MP 
E G 2 7°C?7"7A7. t- U — A tr br^x— 7\ 1f7"b7 

n h & aaf n - \mm l ih»he; l t mTj-ri. . x 

n - H $ *ufc tr'^f- 7 t b 7 x v t ; - * < 4£-J& 
£#Utf&, YCrCb7t-7'V hOiJ>Wx-7i: LT 

« 7 - v y x -f y^meg i o 5 £ii ^xs , 
[oo2s] cf7i/yf^ y ^mss io5it mm?- 

7 b 7* v 7 4 7 X x - * a: b 7 -b>Hji{i Tl^f- -I. . 
b 7 -b /WttOi&Hx - 7 b 7* 7 7. * 7 X x- 7 i: <?>&f& 
<7)ltmZ. ctffifc:«J:oT#i5t£ix&„ i?)«filt47"97 
77.x— ?co&\Z7-te)Mz-o\^X%<7)jffi&<08l-&^$: 
TrrfJ ^57 7 Xfo 0 . WiWr— 9 b 9 -te/l^oSji^ 
«l-ai:*S. LtztfiX. M£l£. a = KOt7t 

^(i^^StL^r^. KMC a = 0(50b^b;Hc-p^T 



[0029] NTSCxy3-/l 0 6.(4. «7l/yf 

s c ^oiefcfiMg^KSSi lt. TV200W y^- 

[0 0 3 0] *?-^7M 0 4a. X^r— 7 1 0 4 
b. fcJ;tA'7 -T^^ 1 04 c(4. tf^t'J (VRA 

m) 1 0 3(ciwi3*tfcy w > ^-p- xmm<D? 

S a D n K^t-^ ^fttcigttibn.^ cot* 0 , « 7V y 
r 4 y^™ i05C± *-&j«wife:*«f o x . ^'7 7 

STV2 0 0fflC0B!^«^-{C^-a:T®Mf ht^M 
W.7 4 )V9 V yftim&fi? . i*lfe*7--'NV y h 1 
0 4 a. X7--7 1 0 4 b. teXTf? 4 )V? 104c(: 

[0031] ^7 -f -./wcom^mmzmi 

T(i. a*:*r«CDS>4 : a : ES : SO7-fyc0^77^77. 
x-^ fc-€-*i*«tt 2*^)«ft^9^ y^77 -f 7 
Xf-^t Sr#tf 3 7-f ?Xf-^^'i) 

1,-r— ^Jittflrcbr-r^t-U cvram) i03-A>f>^ 

7>f t3SStC^^tB $ . 77 -y M 04 a 
^ii^S. t'f^t'J (VRAM) 10 3C(i/7 

7 ^xf-^'ii'f yf'^^^-t-Wf-^i; 

tTf^ftSixTfcD. *7-^7M04atll A 
yf'/^X*?-^- W57 ^ 77.7 i '-^^'M^m 
UlIfcb7-fe/W#ftT*i&®-r— ^ tlltYCrCb7^ 

0 4b T'i4 . YCrCb7t-?yb S 3 7 

^ >-*tl?tlcOT—?£*t LT. 7-f yJHfcBfJ&OK? 
b/HSc^eT^K^TJ^OTLT-- 'J >7'Wmi> s '47htl& . 

ibW«^ic|fc*:*fcJ±ll'h$*i. t'f^t'J (vr 

AM) 1 0 3C/7 7 -f 77,x-7fc LT«lI$iX^R 
S4. ft P3TJ43K . P3 i: LT T V 2 0 0 tc^T't -i» J; 
7 tci^r-S. ^ 

[0032] f LT 7fc¥7.7-- U y^tltzm— b7 

#.|jiTSit7 >r U yftOMtfy 4 >V9 1 0 4 c 
-5 T ^T^iX 4 . SH 7 4 )V9 V y 7M31T{4 . 3 > 
•€-#x-f tLOWJE-r 4 b 7 izMMMHSttS XWiz^X 
cry^M&ifi b 7 b /t^ft ^ix . .rfxtJ: 0TV«^ 
m<niyA >ftcD7'7 7 -f 77.x-7^jS;§ix4 , c: 

iXt: J; 0 . /^77^ 7.7 i '-7<73Jl?^ : i : l|!4#'TVfflH* 

A 7 U y^ai-J: 0 s m&cDX t-—? 10 4b l/Zi. -0 
T9W y=»d« {zftMx&A-eV-x^r— V y^mwizS. 
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t X ^x 7- U 77£*i#: isi-b" ^ -fe /WiBcof - 7 
#«»* 9 4 y&m a JKC-t ft ^ r- * mar**? * ;U 
7 U 77"£1t3 £ fc fc«fc 0 , A&Xtr— U 77Mffli:g 
it 7 * /t>7 'J y/imt^^ 75-f ^W'SHflSftft 

-TkC^ft. h'f^t'J (VRAM) 1 

^7^:11 (VRAM) 1 037>:t777 U -yx »J T£ 

>'/ia^U$J; < M-frft J: 3 fcfc* . iot, Wat* 
^^^'J^VKilgCOtW^^'J (VRAM) 103 
£ffl«L-3r< 1 1 , 757 -f 777 1 '-7^TVlCap n n « 

^t-ftciktfWk&ft. 

[0034] 12 (3(4, n 1 ^Mfi«^Jffl^a^)** 

Wfi&<7) DVD-ROMb'7^7'1 0 l£W8LfZgSW8 

7 !/ 7"-^ 3 y7n/5AJHW4 - fc ft . £ 
coM$SS5j^J#P£ISfci2 s c p u l l s Thxh/pci 

7'J >y v 1 2 , ±7*: U 1 3 , O S^fflC0VX7 RO 
M14, l/Oayhu— JU-y— YTvA 1 5. USB 
3*7 7 1 6 , 3>h n— ;W-?*/W37>t— 77j|jS£ 
ff 3.j£#><9LED 1 7, -ay Yu—)Vf^)V^:W^th 
t&h<7)%m.3-— J fWfeX -i 7f 18, ^^jifi^-b 
19, RS 2 3 2 C3*77 2 0, ^XfABIOS^ 
W^777yiROM2 1, 777^*^- 
F (SSFDC) fflV^7h22, D / /A3>v i t — 7 2 
3. AC3f3-/24, i5«fct**— f'-f jj-S^r-9-2 5 
fcjDi., fa<0DVD-ROMK5^7'10 1, MPE 
G2f3-ri 0 2. b'f^t'KVRAM) 10 
3. ;feJ;r/NTSCx>'3-7i 0'6a*KW€>;fVt^ 
ft, 

[0035] CPUHIt ZCOyXTJ±-£fo?>W)fFi: 
Wm-&h<7)X*fo*). ±7^U 1 3£n-F£ti*:^ 

>'7"n 77 Afc J: Y^A) s"7°E? 7 7 A SrUfff 
ft. 

[0036]*7 h/P C I 7 U >y 1 2 (4, 7'D-fe y 
UPCI a'X2 t<7j^T'h7>--!f7>-a 7£;R 
*H*lT33frfft^A<OL S I X'fo 0 , 70-te 
777 x — 712UPC I t^XA 77 7 x — 7 1 2 3 
Srflffii.TV^ft. ifc s *7f/PCI7''J'yyl2(: 

(4, c p u i i # iiPfchJ^toffe^p c I .m"x-777 

*»4>»ff 7 U U - b h 5 7Hf 7 ya>. 
tf-^TiX^'J 1 3t3Jrt>'V77ROM14SrT'7-fe 
7$iJ»-T ft Xt'Jnybo-7122 #*tfttt fe, tLT ^ 
ft. 



[0 0 3 7] I/037ht7— ;P7'— bTW 1 5li# 
a 1 70 x ft fc«><0 1 ii<7) L S I X'fo 

0, ivlfcii, iS«J;3t, PC IA7 2hF*}gflPC 
I A.X2 aPali'^-CPC I >77x-7 1 5 

1. fiSUPC IA'X2 a fcftSn SA^7 2 blH&oS: 
<*PC I/I SA7U -y^'l 5 2#l£ft£>ftTOft< > 1*1 
g|3PC 1^X2 a (£(4, USBr3*77l 6 (CjgigSix 
ft*Wr-tf- H^fOjai3ai{SSr$iJfflI-rft U S B A y 
^7x-7l53fc, DVD-ROMH7>f 7"1 0 1 £ 
I«t4^U7^^ I D E3 >- h u-y 1 5 4 i: s 
U^7 7^ 777 t -7t;*f-rft77- , J y^iV'7 
-f /U7 U y/Wf, J;V'7'77 ^ 77fcUBx-7 k 
CDa 7U-77-' -f 77^r k'Sr^r 3 7* nyfn- 
7l55t, F^gHPC lAX2ai:MPEG2f3-^ 
1 0 2i:OP B 1<7)^7^-7x— XMfPSr^ToMPEGW 
777x-7 1 5 6^881^^4. 

[0038] fari/^f a y h 0—7 155 fei±, b" 

f^t'J (VRAM) 1 0 SZTpJzXMm-t&X^ 
'Jr?>-ho-7 2 0 1 . CPU1 l^^^fl^tSflg^T 

b'-y h^yr^^/iHM^^ff 3 b'-y h7U «y 
h (Bit Block Transefer) I38&2 
0 2, /77-( ?Vt'f3|-S^t2 0 3 , PCM.f- 
7*^^-rJVhn— 5 2 Q4ifiB.WL>tlX^h. 7'77-r 
77/h"f^S^1"2 0 3 {4, 111 !<?>*} y—ills-y h 1 
0 4 a, 77-71 0 4 b, 7 ^^71 0 4 c, fcitf 
a 7V yf >f 77'HSS 10 5^t' Sr^T'V > ft . PCM 
7 i V^-=J7l-n-7 2 0 4(4, 777 ^ 77 x— 7 
tc-ftBt-r ft 3&#&s8r kcDW^x- 7SrPCM ?J-— f a * 
r- 7 fcrSEflW* P c MWJIT^ ft . 
[0039] Cioll2^^7- : fA(ct5(fftt6B7 1 '— 7*5 
J;tN*7'77 7X"f- fco-Sfdxir&nm 0 ft . -f^r 
77 7 -f ^7|S^ffl<7)rrU7— v-a 77°n75 
A7r^;H4, DVD-ROMK?^ 71 0 1 frt>m& 
tB^ixT, ±7* 'J 1 3(cn— F§^ft„ -f- LT, -?-<5D 
7n7"7AcoftiJ#P<^T, CPU 1 1(4, »ja7 J -7^)W 
f»»t't VZWSth???* 77f-7^bW 
7^'J (VRAM) 1 0 3iC?SH-rftfcfttC, *J*r- 
7& P CMt-f-< ^-n 7 fn-72 0 4(ci!Sjl-rft . 
7-7 7 >f 7 7.7bx^r 5 -9" 2 0 3 (4, 7 ^ U n 7 h u 
-520lSaUh*f^t"J (VRAM) 10 3*^ 

4»fS^M*7-( y%-&t!tn$k7A yco^yy <i 7x7- 

7 £ ■*4MWMte3(ffifc«*aj t , It) j* Lfok^FX 7- U 

77Ma*3 Jttxsi[7 -f ;i^7 u y7W&&>M y°yA y 
tmx-mj-rt . pcM*-f^3yhn-5204 

(4, ; &^f ;- -7lrPCM^--f i >^x-7«mt, 
tl^D/A-zyrt-? 2 3(=)S-T. 
[0040] «)Hx-7(4, ±7^r 'J 1 3 SrtfS 
-fC, DVD-ROM K^-f 71 01HMPEG2T 
3—7*1 0 2fc:a«WtC(gjM$fL4. MPEG2f3- 
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y\ 0 2T14. MPEG27°n^'5^XhU-AtC#^ 
li|,l:T^j;y'tyt7f-fmmf3- K Six 
T . YC r C b 4 2 2M^f>7;H:T^f-^* s 4 
BitStl-g.. MPEG2 7°a^7AXh>J-AtC-^ 

iiH>^-f^f-?C0V^li-f«7)iiMPEG2 
f3-yi 0 2i^AC 3f3-^"24 tcMfeil. 
•Cf?- KSixS . H SifXJtYC rCb422f 

^f-9-2 0 3t3!i£>;fX. A 7X?-?bci27°U> 

■T4>? r Ztl&. <¥■ LTs NTSCxya-n 0 61= 
i^TTVfflORifjfMI-f-C^StL^f*. TVfcM y? 
-1^-X^§^I>. ife, AC3fa-/24(:J:o 

t2 5(:J;^tPCM.t-f^3>'bn-7 2 0 4*» 
kOtf-x^x-^irl^SixT. TVO^A7J9 

[ 0 0 4 1 3 H3 ^5 7 4 ^X/b'T^S^Mf 2 
0 3 *<0«2l^tW*l ! firllIB&ai**«jj?SfL't . ^ 
5 7 -f ? X/b-r:* 5 ^ 2 0 3 tct4. K^co J; 3 fc, 
*l/y-M 7 7,r30 1, *7a^77T302 s 7 
/^TV-^-9-30 3. h3 04. ^l^Vl- 

X^r— ij • H 7 -f IV? 3 0 5. 'J y 

y ■ H 7 -f 3 0 6, x 4 H 0R3O7; YCr C 
b444/422^HK308, 30 9. b'7t75 
^yA' 7 7r3 1 0. V7-f /U?3 1 1 . F I FOVS'.y 
7 r 3 1 2 , tsWa 7l/Vf-f y^E^^'ISft^XT 

[0042]*I/y KK>y 77301 *5«fcl/r*:?X 
7 7r3 02lt .X^ynybr?— 52 0 IfcioTb 
fsM^'J (VRAM) 1 O30»S>JSfi&? f — *1MX# 

7 ^^f-^fej;^7^ ><D?7 7 4 fx"?—?* 

i4\ b'f^t'J (VRAM) 1 0 3tCttlft$/T.*>f y 
^f-y 7 X%7— ^6— KC0^"5 7 4 ^Xf-^8f'y K 
/b°?-fe/VC\ fiOh'f^^'J (VRAM) 10 3CO 
^—f^XifiS 2 tf y I-T'fofxif. m^ttm^J 
77 J 7 XT-'—? kHZ? 4 VW77 4 tX^f—fkifi 
ZtlZ'ixS V?4z)l%.{&X'&mzm*-lii Sill. £ £ 

[0043] V/l'fri/ ? 3 03li, # U y h K y 7 
r 3 0 1 te&lf*? X hA-y 7 r 3 0 2 £35St383? 
L . JSiR L*y < -/ 7 r $ ixT V \h A y r v ? x # 
5—^— 7 -< ;xf-^ £ b? •k/kflE{&TS' 'J 

3 0 4 1386*1$ .■ 

[0 044] #5-->n°W h3 04J4. H4^$*XT 
iri dic:. 2 5 6«Da:y h'Ji:. ^ Vx-y^xttt 
LTA7j£;fx6 S b>y Ncpt^-b/t-r-^frx^- H L 
T2 5 eJIcOxybyco+mo^SSM^STFl^X-r 



a-:^a»6titofe$*vrv^. #xyhytc(±. 4 44 7 
hlzMRttZ 2 4 b>y hcOYC r Cbf-^ 
, 8 b* v h co a mt com&h h t ibBfe £ irx t > 
#9-><CW b3 04ft»6iitf)&t'l&4 44 7*— 
V v h O Y C r C b -r'- ^ J4 . 77 P >- !- X 7" — 'J > ^ • 
H7-f/^30 5£jt{4*?X 1-X7-— 'J - H7^ 
A* 3 0 6 tmioixl. . affitOV^TJis f-fl^ 

0S& 3 0 7 tciM4>tL . ?m y y^ i 

t/SS[7 <f /l/^ y y^MHOBtP^^'ttilSS^fe^. F 
IFIA 7 7r3 12b^fLTa;7'l/ > -r ^ y^0» 

3 12tii^l§ 0 

[0045] 77^>'hX7--y>'iJ'-- H7^/^305 
fci:^^ X h X^r- U y7' ■ H 7 -f 3 0 6 {4. 
ix-?'ixa^^5^ ya^lF^A vco-7 7 7 -i ^xf 
~i>\,z1^th^7 j )V? U >-7" • x^-— U y/®il: 
. HfT^"*/S«X0 «T* 0 . *7-A"l/7h3 04 T-4 

4 4 7>— V«y h«Y C r C bf-^ t^iS^^ 

"y<nV7 7 4? xf-^(i* uybxy—vy 
7 • H7-fM3 0 5fcA2jS*U 4fc*9— -"Cl^yh 

3 0 4T°4 4 4 7 *— -Vy h<5DYC r C bf-^Cfl 
§^^»#^-f y<r>?77 4 fx^r-fliAUyb 
XT'- y y ^ • H 7 -f A-r^ 3 0 6 tATJ SilS . 

[0046]*UVb xy— y V7 ■ H7-f Ar? 3 0 5 
{4. StttLTA*S*i4«5%W«9^ytC*-^&'44 4 
7t-7 7 hOYC r Cbf^tMU, t-f. ffff 
feci: X/&m^mi&mc0iZ}frcr>7}t : ¥-7 4)V*V >?im 

mute j; o T^ii$ix§ . El 5 0*^7 -f /W^ ®g§{4 3 
^ -/7°«figT'*> 0 . mWttZ 3 b*^-fe;Ha^)flM[|SI3( 
Srff a fcbblz, Ziz^ix l b°^ -fe ^frfcW-r? ^gffi 
■fS 2 -f U-f HI8&5 1 1 , 5 1 2fc. S^comM 
§15 13, 5 14. 5 1 JD^5 1 6&#>&«j£ 
. S^5 13, 514, 515 -e^X-e - fLC0 

»ii{4. 7 -r frffflwmuitx? 314 fcsue$ix 

[0047] 7jc^p7 y y^fc itxx^-— ij 

^^f^W^5W yc0b°?-fc;M4YC r C b 4 4 4/ 

4 2 2^®SS3 0S{;5M^ix. KT'4 2 27t-7 
•y hcOYC rCbf-^ $ iX/t ^ . V7^W3 

[0 048] *^X!-X^— 'J y^ - • H7^;^306 
(4. ia^ctTA7l$ix-|,^5-f y(lStl»4447t- 
^.yhCOYCrCbf-^tSLT, *-f. !WJK*5J;t/' 

fefI^Wffi?i<7)fc:^co7[< ;s F7 ^ U y^35PItrtT 

v\ -s-cof*. *f77--'j ymi&txn&m- *m&mi 

•ft* Z<7)*¥7 4)V?mm±F I R7^;^iffll.* 

oT^frSii* cot* 0 . EI5 COSS& 
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(54) System to multiplex and blend graphics OSD and motion video pictures for digital television 



(57) A system is provided to multiplex graphic and 
Motion video pictures for digital TV set-top box. The 
motion picture is generated by an MPEG Video decoder 
and the graphic windows are generated by an OSD Co- 
Processor. Each graphic window is characterized by a 
set of attributes that define the display mode, position 
on the screen, priority and blend factor. When a window 
is blended, the motion video and OSD color compo- 
nents are added together with a proportion of each 
defined by the window attributes. Decimated motion 
video picture can be also displayed within an OSD win- 
dow; the OSD Co-processor generates an empty win- 
dow that is filled by the video decoder with the 
decimated motion video. 
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Description 

FIELD OF THE INVENTION 

This invention relates to System to Multiplex and 
Blend Graphics OSD and Motion Video Pictures for dig- 
ital television. 

BACKGROUND OF THE INVENTION 

Digital TV set-top boxes are currently being tested 
and utilized in some areas. However, these boxes often 
provide insufficient capabilities for displaying windows. 

SUMMARY OF THE INVENTION 

A system is provided to multiplex graphic and 
Motion video pictures for digital TV set-top box. The 
motion picture is generated by an MPEG Video decoder 
and the graphic windows are generated by an OSD Co- 
Processor. Each graphic window is characterized by a 
set of attributes that define the display mode, position 
on the screen, priority and blend factor. When a window 
is blended, the motion video and OSD color compo- 
nents are added together with a proportion of each 
defined by the window attributes. Decimated motion 
video picture can be also displayed within an OSD win- 
dow; the OSD Co-processor generates an empty win- 
dow that is filled by the video decoder with the 
decimated motion video. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will now be further described, 
by way of example, with reference to the accompanying 
drawings in which: 

Figure 1 depicts an OSD window blended over 
video; 

Figure 2 illustrates two windows over a full screen 
background color; 

Figure 3 depicts decimated by Vi of motion video 
pictures; 

Figure 4 shows a decimation filter algorithm; 
Figure 5 shows video output timings; 
Figures 6A and 6B depict the main blocks of a sys- 
tem to multiplex and blend graphic and motion 
video pictures of the present invention; 
Figure 7 shows the timing of OSD outputs in differ- 
ent modes; and 

Figure 8 shows of an OSD/video 4 levels blend 
matrix. 

DETAILED DESCRIPTION 

The video decoder (Figure 1) decodes MPEG2 
data and built the motion video picture into the SDRAM, 
and display every frame a new picture. The OSD win- 



dows can be displayed over the motion video or blended 
with the video with different levels of blending. The coor- 
dinates, size and display attributes of each windows are 
defined in the window attribute memory. During display 

5 the OSD Co .processor read and interprets the OSD 
data stored within the SDRAM. A window can be: 
graphic, bit-map, still video or empty. The Figure 1 
shows a full screen motion video picture with an OSD 
window. During the parts of motion video the Luma and 

w Chroma is generated by the video decoder and trans- 
mitted to the video output through the input A of the 
Mux. In a graphic window the Luma and Chroma are 
generated by the OSD Co-processor through the input 
B of the Mux. If the window is blended, motion video and 

15 graphics are added together with a proportions defined 
by the window attributes. 

Figure 2 contains two windows over a full screen 
background color. The window 4 contain a graphic, bit- 
map or still picture and the window 1 contain a motion 

20 video picture. The position and size of the each win- 
dows are defined by the attributes stored in OSD Co- 
processor Every frame a picture is read and decimate in 
real time. The decimation ratio is defined by the window 
attributes. 

25 Full screen and decimated by Va motion video pic- 
tures are shown Figure 3 and Figure 4 shows the deci- 
mation filter algorithm. The video decoder decimate 
vertically by reading the source video every two lines. 
The line n+1 and n+3 are ignored. Horizontally the dec- 

30 imation filter decimate by 2. The number of pixels is 
reduced horizontally by 2. Pi is generated from Pj and 
its neighbor Pj-1 and Pj+1 . The result of vertical and 
horizontal decimation is a motion picture 4 time smaller 
than the original picture, in this example three pixels are 

35 used to generate one, more complex filters with 5, 7 or 
9 pixels can be used to improve picture quality. Different 
ratios of decimation are possible: 1/2, 1/3 and 1/4. 

Figures 6A and 6B represent the main blocks of the 
system to multiplex and blend graphic and motion video 

40 pictures: the MPEG video decoder and the OSD Co- 
processor, traffic controller and SDRAM. The data to be 
displayed are stored in SDRAM, the traffic controller 
manage the access to the memory. 

The video decoder contain several blocks to 

45 decode and display the MPEG2 data, they are: RISC 
CPU, VLD, IDCT, Motion Compensation and video con- 
troller Modules. The CPU execute micro-instructions, 
handle interrupt, control and synchronize modules and 
schedule traffic to SDRAM. Only the video controller is 

so detailed in Figures 6A and 6B. The CPU manage the 
transfer from the motion video source picture to the 
Video FIFO. A 32-bit word contain 4 Luma YO to Y3 or 2 
chroma samples CbO, CrO and Cb1 , Cr1 . The transfer 
between SDRAM and FIFO is done by burst. During the 

55 display the video controller access samples in FIFO to 
generate pixel by pixel the 3 color components: Cb, Y 
and Cr. To reduce memory space the motion video pic- 
ture is stored in 4:2:0 format, Chroma resolution is 
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divided by 2 horizontally and vertically. Chroma is inter- 
polated by the block interpolator that generates the 
4:2:2 picture using the current line and 2 previous lines. 
The polyphase filter required for horizontal re-sampler is 
implemented in the video data path. The coefficients for 
the filter are stored in Taps memory. Filters support re- 
sampling from 360. ..704 to 720 and horizontal decima- 
tion by 2, 3 or 4. The output lnter[7:0] of the interpolator 
generate each pixel a Luma sample Y and a chroma 
sample alternately Cb or Cr, output frequency is 27Mhz. 
The video output is modified in order to be synchronous 
with the system clock 40.5Mhz. Figure 5 shows the 
modified video output and the output of the up-sampler. 
Pixel frequency is 13.5 Mhz. 

The OSD Co-processor controls the display of the 
OSD windows. Each hardware window has the following 
attributes: 

window position: any even pixel horizontal position 
on screen; windows with decimated video have to 
start from an even numbered video line also 
window size: from 2 to 720 pixel wide (even values 
only) and 1 to 576 lines 
window base address 

data format: bitmap, YCrCb 4:4:4 t YCrCb 4:2:2, 
and empty 

bitmap resolution: 1 , 2, 4, and 8 bits per pixel 

full or half resolution for bitmap and YCrCb 4:4:4 

windows 

bitmap color palette base address 

blend enable flag 

4 or 16 levels of blending 

transparency enable flag for YCrCb 4:4:4 and 

YCrCb 4:2:2 

output channel control 

The window position, size and priority are stored in 
CAM memory located in the window display controller. 
The window attributes and CLUT are store in attribute 
memory. The OSD Co-processor manage the transfer 
between SDRAM and OSD FIFO, line by line and by 
segments of window to be displayed. Each pixel it gen- 
erates the color component YCrCb or the CLUT 
address in bitmap. In graphic 4:4:4 mode, the window 
memory contain the 3 color components Cb, Y and Cr. 
In still video 4:2:2 mode the window memory contain the 
color components Y and alternately Cb, or Cr. In bit- 
map the window memory contain the code of the color 
to be displayed, the color components are stored in the 
CLUT. Figure 7 shows the timing of OSD outputs in dif- 
ferent modes. In bit map the code of the color concate- 
nated with the color base address select one. of the 
color of the CLUT. The 3 color components are stored in 
the respective registers and multiplexed at the system 
clock frequency to generate Osd[7:0] output. 

In 4:2:2 still video, the color components Cr, Y and 
Cb are transferred to the respective registers. Every 2 
pixels only Y is modified. The 3 color components are 



multiplexed at the system clock frequency to generate 
Osd[7:0] output. 

In 4:4:4 graphic, the color components Cr, Y and Cb 
are transferred to the respective registers and multi- 

5 plexed at the system clock frequency to generate 
Osd[7:0] output. 

In Figures 5 and 7, the color components of Vid[7:0] 
and Osd[7:0] are in phase and can be combined 
together to blend graphic and video. 

10 When the blend enable attribute is selected the cor- 
responding OSD window is blend over the video. Figure 
8 shows a 4 levels blend matrix. The blend level is 
defined with the window attribute. The OSD output Ch1 
and/or Ch2 are: 

15 

Full OSD: Output is Osd[7:0] 
Full Video: Output is Vid[7:0] 
1/2 Video and 1 /a OSD: Output is Osd[7:1] + Vid[7:1] 
Video and Va OSD: Output is Osd[7:2] + Vid[7:1] + 
20 Vid[7:2] 

Va Video and Va OSD: Output is Osd[7:1] + Osd[7:2] 
+ Vid[7:2] 

Blending can be at window or color level. When 
25 blending at window level is selected the attributes define 
the level of blending according to the matrix Figure 8. In 
bit-map when color level is selected the LSB bit(s) of Cb 
and Cr are used to select the blend level. 

In graphic of still video when blend is enable, the 
30 value zero of Cb, Y and Cr indicate a transparent color. 
The corresponding OSD pixels are replaced with the 
• Vid[7:0]]. 

Empty window attribute selects a decimated motion 
picture in an OSD window. During the display the win- 

35 dow display controller generate a signal: "Decimated 
window control" to indicate to the video controller the 
presence of a decimated window and the decimation 
ratio. The Video decoder decimate vertically by loading 
the video FIFO with the selected motion video lines, 

40 every 2, 3 or 4 lines depending of the decimation ratio. 
The horizontal re-sampler decimate horizontally by 2, 3 
or 4 with the corresponding decimation filter. Window 
control and decimated video picture control select the 
Vid[7:0] output to fill the empty window. The position of 

45 the empty window is selected by window attributes. 

The attribute output channel control selects the win- 
dows to be displayed at the outputs Ch1 and/or Ch2. 
Each window can be selected independently. When a 
window is not selected the corresponding area is 

so replaced by the motion video. This system allows to 
have one channel for VCR recorder that records video 
and sub-title and the second channel with the full OSD 
menu. 

55 Claims 

1 , A system for generating synchronous color compo- 
nents from different display modes comprising: 
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a video decoder, and 
an OSD co-processor, 

wherein said display modes are 
selected from Motion video, 4:2:2, 4:4:4 and 
bit-map, or combinations thereof. s 

2- A blending and decimated window system compris- 
ing: 

a video decoder, and to 
an OSD co-processor. 
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(54) Window processing in an on screen display system 



(57) A system is described that allows simultaneous 
display on a display screen of bit-map, graphic, still 
video picture, motion video picture or background. A 
frame memory containing the page to be displayed is 
located in an the SDRAM. A display controller reads the 
frame memory block by block and transfers the data to 
a Fifo. For each pixel, the OSD decoder reads the bits 



required to display the current pixel from the FIFO. The 
number of bits per pixel varies during the display 
depending upon the mode. The pixel selector and its. 
controller select the bits of data from the FIFO to form 
the current pixel. 
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Description 

FIELD OF THE INVENTION 

This invention relates to an on-screen display system with variable resolution. 

BACKGROUND OF THE INVENTION 

Current OSD systems may employ multiple central processing units (CPUs) in order to successfully deal with and 
handle high speed digital bit streams, such as those associated with a digital television set-top box. Each such CPU 
requires at least its own working memory space. These systems are expensive and may require expensive high speed 
memories. 

The OSD co-processor of the present invention provides for OSD systems that overcome these and other short- 
comings of existing OSD systems. 

SUMMARY OF THE INVENTION 

The present invention provides an OSD co-processor that allows for an OSD system having simultaneous display 
on a display screen of combinations of bit-map, graphic, still video picture, motion video picture or background A frame 
?u m ^IL COnta,n,n9 a Page t0 be dls P |aved is Preferably located in an external memory, which is preferably SDRAM 
The OSD co-processor includes a display controller, . a FIFO, an attribute memory, a window controller, a decoder and 
line and pixel counters; the co-processor may also include an address calculator. A display controller reads the frame 
memory block by block and transfers the data to a FIFO. For each pixel, the decoder reads the bits required to display 
the current pixel from the FIFO; the number of bits per pixel may vary during the display depending upon the mode A 
pixel selector and its controller select the bits of data from the FIFO to form the current pixel. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will now be further described, by way of example, with reference to the example with refer- 
ence to the accompanying drawings in which: 

Figure 1 depicts a high level architectural diagram of an audio/video decoding system employing an OSD co-proc- 
essor of the present for to displaying an OSD picture; 

Figure 2 depicts display modes of an OSD co-processor of the present invention and their associated memory 
requirements; 3 

Figure 3 depicts two representative OSD pictures generated by an OSD co-processor of the present invention- 
Figure 4 depicts how a CPU builds windows in a portion of its memory and the windows are used to build a frame 
in a frame memory which is displayed by an OSD co-processor of the present invention on a screen display- 
Figure 5 dep.cts a high level architectural block diagram of an OSD co-processor of the present invention and 
selected interconnections; 

Figure 6 depicts two windows having different color schemes that illustrate how an OSD co-processor of the 
present invention displays two overlapped windows; 

Figure 7 depicts how a portion of the windows of Figure 6 are stored in a frame memory; 
Figure 8 depicts in more detail selected portions of the blocks of Figure 5- 

Figure 9 depicts a portimvora-wM «*t m g m; . d r the present invention-' 

Figure 10 depicts portions of a memory cell and merfwrjri^^ 
essor of the present invention; 

Figures 11-13 depict the generation, assembly and display of portions of windows depicted in Figures 6 and 7; 
Figure 14a depicts representative window transition timings, such as those for Figures 6 and 7; and 
Figure 1 4b depicts representative pixel selection and multiplexer timings for Figure 1 3. 

DETAILED DESCRIPTION 

The present invention provides an OSD co-processor for an OSD system. Figure 1 depicts one such OSD system. 

Figure 1 shows the global flow for decoding and displaying an OSD picture. The PSO buffer contains the coded pic- 
ture, for example: Teletext data to be displayed within an OSD picture. The ARM CPU decodes (1) the Teletext data and 
builds (2) the OSD picture using a Bitblt hardware accelerator. The OSD controller reads (3) the OSD buffer and gen- 
erates the OSD video that is mixed with MPEG video (4). 
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Different modes may be displayed simultaneously on the screen: A bit-map window with 2 colors, a still video pic- 
ture, a 256 colors graphic window, a decimated motion video picture and a Logo in true color. The OSD co-processor 
minimizes the memory required to display service information. The OSD uses a new hardware windowing technique to 
mix different modes of display such as: bit map with variable resolution, graphics, still video picture and decimated 
5 motion video. 

Figure 2 depicts the various modes of display supported by the OSD coprocessor of the present invention. 
More particularly, the OSD co-processor supports: 

1) In a bit map the frame buffer contains the code of the color of each pixel to be displayed. The number of bits per 
10 pixel defines the number of the colors that can be displayed on screen. Two colors require 1-bit per pixel and 256 

colors require 8-bits per pixel. This mode is used to display graphics and text. The code of the color addresses the 
Color Look Up Table (CLUT) that contains the three color components with 8-bits each. 

2) Graphic plane, 4:4:4 mode, uses 8_bits per pixel for each color component R,G,B or Y.Cr.Cb. Each pixel requires 
24-bits (16 million colors per pixel). 

is 3) With the 4:2:2 mode the resolution of the chroma is divided horizontally by two. Each pixel has a luminance com- 
ponent Y and alternately a chrominance component Cr or Cb. This mode is used for video still or motion picture. 
Each pixel requires 1 6-bit. 

With the 4:2:0 mode the resolution of the chroma is divided by two horizontally and vertically. Each pixel has a lumi- 
20 nance component Y and a chrominance component Cr and Cb for 4 pixels. This mode is used by the MPEG video 
decoder to the size of the memory required to store a video motion picture. Each pixel requires 1 2-bit. The chroma inter- 
polator generates the 4:2:2 output format. 

Current techniques for OSD display: 

25 

Table 1 shows the number of bytes required to store a full screen picture 720 pixels x 576 lines in different display 
modes for an OSD system that does not allow mixing of several modes of display in real time on the same screen. When 
one part of the screen requires 256 colors, the full screen must be 256 colors even if a part of the screen requires only 
2 colors. 





Display mode 




Number of bytes 










full screen 


35 


Bit map 
pixel 


1-bit 


per 


51840 ! 




Bit map 


2-bit 


per 


103680 


40 


pixel 










Bit map 


4-bit 


per 


207360 




pixel 








45 


Bit map 
pixel 


8-bit 


per 


414720 




4:4:4 graphic plane 


1244160 


50 


4:2:2 video mode 


829440 




4:2:0 video mode 


622080 



Table 1: Number of byte for full screen display 

55 



However, the OSD coprocessor of the present invention can display several modes described above simultane- 



3NSDOCID: <EP L0B40276A2J_> 



EP 0 840 276 A2 



X 



ously on the same screen. Each part of the screen with different display mode uses a windows fully programmable in 
size, in position and priority level. The windows can be overlapped without limitations. The characteristic of each win- 
dow is defined by a set of attributes stored into a SRAM. Those attributes are used to calculate the memory address in 
real time during display and to control the hardware display system. 

Windows on Background Color MPEG Motion Video and Blend Window 



Window size 




Number of bytes 




Window size 




Number of bytes 


90x72 


4:4:4 


19 440 




540 x 504 


2-bit/pixel 


68 040 


360 x 288 


1 -bit/pixel 


12 960 




360x144 


4-bit/pixel 


25 920 


360 x 144 


4-bit/pixel 


25920 










180 x 144 


4:2:2 


51840 










720 x 576 


Background 


0 












Total 


110160 






Total 


93 960 
















720 x 576 


Full screen 4:4:4 


1 244 160 




720 x 576 


Full screen 4- 
bit/pixel 


207 360 



25 Example of OSD Picture Memory Requirements for Pictures of Figure 3 

Figure 3 shows typical OSD pictures. The left screen is composed of 5 OSD windows with different characteristics 
displayed on a full screen background color: 



30 a bit-map window 360 pixels by 288 lines with two colors that requires 1 -bit per pixel, 
a bit-map window 360 pixels by 144 lines with 16 colors that requires 4-bit per pixel, 
a graphic window 90 pixels by 72 lines with 16 million colors that requires 24-bit per pixel, 
a still video picture window 180 pixels by 144 lines in 4:2:2 format using 24-bit per pixel, 

an MPEG motion video window 180 pixels by 144 lines in 4:2:0 format. The window size and position is generated 
35 by the OSD system. The MPEG video decoder generates the content of the window by decimation of the full screen 
picture. 

This OSD picture requires 1 1 0Kbytes memory. Without the OSD coprocessor the memory could be up to 1 .24Meg 
bytes. 

40 The right screen shows an other picture composed of 2 OSD windows displayed over full screen motion video: 

a bit-map window 540 pixels by 504 lines with two colors that requires 1-bit per pixel. The background color is 
blended over motion video: and 

a bit-map window 360 pixels by 1 44 lines with 1 6 colors that requires 4-bit per pixel. 

45 

The memory size is 93Kbytes with OSD coprocessor compare to 207Kbytes without OSD coprocessor. 
Display flow: 



so In frame mode (figure 4) CPU and frame uses different memory area. The CPU build the windows separately into 
the CPU memory, each windows has its own display attributes i.e. display mode, resolution. The new display picture is 
created by the CPU by coping sequentially with each segment of the window 1 and 2 in such way that the OSD display 
controller reads the frame memory sequentially and display line by line from the left upper corner to the right lower cor- 
ner. The display area that does not contain any OSD data, as background color or motion video are not described into 

55 the frame memory. For each transition of window, each line, he controller changes synchronously the attribute in order 
to display the window with the corresponding mode. The number of bits to display a pixel of the window 1 and 2 can be 
different. 

The block diagram of the OSD coprocessor is shown figure 5: 
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Line counter: The pixel and line counter receives the pixel clock, generate X, Y that represent the pixel position on 
the screen and synchronization signals Hsyn and Vsync to control the screen display. 

Windows Controller: contains the positions X and Y of each windows to be displayed on the screen. The controller 
compares X, Y position, and indicates to the display controller each window transition and window number. 
5 Address Calculator: Not used in frame mode. 

Display controller: For each new window transition the display controller read the new attribute from the attribute 
memory. It generates an address for the display memory and load the Fifo with a new block of data. It generate the 
attribute for the current window to the Decoder. 

Decoder: For each pixel the decoder extracts from the Fifo the number of bits corresponding to the current pixel to 
10 be displayed. It transform data bit in pixel. 

Windows attributes: 

Display modes: empty window for decimated video. Bitmap. YCrCb 4:4:4 graphics component, YCrCb 4:2:2 CCIR 
is 601 component and background color. 

Supports blending of bitmap, YCrCb 4:4:4, or YCrCb 4:2:2 with motion video and with an empty window 
Supports window mode and color mode blending 
Provides a programmable 256 entries Color Look Up table 

Outputs motion video for mixture with OSD in a programmable 422 or 444 digital component format 
20 Provides motion video or mixture with OSD to the on-chip NTSC/PAL encoder 
Each hardware window has the following attributes: 

window position: any even pixel horizontal position on screen; windows with decimated video have to start from an 
even numbered video line also 

window size: from 2 to 720 pixel wide (even values only) and 1 to 576 lines 
25 window base address 

. data format: bitmap, YCrCb 4:4:4, YCrCb 4:2:2, and empty 

bitmap resolution: 1 , 2, 4, and 8 bits per pixel 

full or half resolution for bitmap and YCrCb 4:4:4 windows 

bitmap color palette base address 
30 blend enable flag 

4 or 16 levels of blending 

transparency enable flag for YCrCb 4:4:4 and YCrCb 4:2:2 
output channel control 

35 Example of OSD display with 2 windows: 

The figure 6 shows an example of display of two overlapped windows. The window 2 on back is a bit map with 16 
colors per pixel. Each pixel require 4-bits into the frame memory to define the code of the color. The window 1 on top is 
a bit map with 2 colors per pixel. Each pixel require 1 -bits into the frame memory to define the code of the color. The 
40 position and dimension of the windows 1 is given by the attributes X_1 0, X_1 1 , Y_10, Y_1 1 . Horizontally the number of 
pixel is: X_11 - X_10. Vertically the number of lines is: Y_11 - Y__10: Same for window 2 with X_20, X_21, Y_20 and 
Y_21. 

The display controller access sequentially the display memory (figure 7) from the first word containing the pixel 
XJ20, X_21 to the last word containing the pixel X_1 1 , Y_1 1 . Details of the line 20 is shown figure 7. The line begin with 
45 pixels of the window 2, window 1 start in X-10, Pa is the last pixel of window 2 with 4-bit per pixel, Pb is the first pixel of 
window 1 and use 1-bit per pixel. Window 1 end on Pc and window 1 restart in Pd until pixel position X_21. 

The same word contain pixels of window 1 and 2. During display the window controller detect the transition 
between Pa and Pb and control the data processing algorithm after Fifo access. 

so Pixel selector and multiplex: 

The pixel selector and multiplex is the input of the decoder block shown figure 5. It receive the outputs of the Fifo 
and the windows attributes and control signals from the display controller. The basic function is to transform data stored 
into the frame memory in pixel. In case of bit map display (figure 8) the output, Pixel_Mux[7:0] is the address of the 
55 CLUT (Color Look Up Table). For graphic or still video picture the output is one color component. Pixel_Mux[7:0] output 
is produced by bits coming from the Fifo and bits from attribute memory. 
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Pixel selector: 

Receive 32-bit data from the Fifo outputs F[31:0]. The first stage select one of the five bytes F[31 :24], F23:16], 
F[15:8], F[7:0] and F[6:0] delayed by one clock sample. The second stage is a half barrel shifter that allows to shift right 
a 15-bit input data by 0 to 7 position. The output of the barrel shifter position the LSB of the code of the pixel to be dis- 
played in Bs[0]. The pixel counter provide the control signals for the multiplexor and barrel shifter. Table 2a shows the 
effect of the control Mux__S[1 :0] on the bytes selection and 2b the output of the barrel shifter in function of Bs_S[2:0]. 
The table 2c combine the table 2a and 2b and shows the bits of the Fifo selected at the output of the barrel shifter in 
function of the 5_bit pixel counter. 

Multiplexor: 



15 



Receive data Bs[7:0] from the barrel shifter and Base[7:0] from the attribute register. It is controlled by, 4 control bits 
coming from the attribute register, Cursor and default signals from display controller as shown table 2d. 
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Table 2a, 2b and 2d: Pixel selector and multiplex control 

i-X-.. i ... 5.. .'. • . ' I. : .. '.' l .... 
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Table 2c: Pixel selector control tables. 



Default: When active Pm[7:0] Is equal to the 8-bit default color provided by the general control register of the display 
controller. No data is read from the Fifo. 
55 Cursor: When active Pm[7:0] is equal to the 8-bit cursor color provided by the general control register of the display 
controller. No data is read from the Fifo. 

Bp[3:0]=0000: The current window is empty and contain 0__bit per pixel or color component. Pm[7:0] is equal to 
Base[7:0] stored into the attribute register. In bit-map mode the Base[7:0] select one of the 256 colors of the CLUT as 
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a background color. 

Bp[3:0]=0001 : The current window contain 1_bit per pixel or color component. Pm[7:0] is equal to Base[7:1] con- 
catenated with Bs[0] from the barrel shifter. In bit-map mode the Base[7:1] is the base address of a set of 2_colors of 
the 256 colors CLUT. 

s Bp[3:0]=001 1 : The current window contain 2_bit per pixel or color component. Pm[7:0] is equal to Base[7:2] con- 

catenated with Bs[1 :0] from the barrel shifter. In bit-map mode the Base[7:2] is the base address of a set of 4_colors of 
the 256 colors CLUT. 

Bp[3:0]=01 11 : The current window contain 4_bit per pixel or color component. Pm[7:0] is equal to Base[7:4] con- 
catenated with Bs[3:0] from the barrel shifter. In bit-map mode the Base[7:4] is the base address of a set of 16_colors 
10 of the 256 colors CLUT. 

Bp[3:0]=1 111: The current window contain 8_bit per pixel or color component. Pm[7:0] is equal to Bs[7:0] from the 
barrel shifter. In bit-map mode the 256 colors CLUT are used. 

Pixel counter: 

15 

Provide the control for the pixel selector Mux_S[1:0] concatenated with Bs„S[2:0]. Each beginning of frame the 
pixel counter is reset. It is decremented by 0, 1 , 2, 4 or 8 depending of the current window attribute. Address clock signal 
is generated when the counter cross zero. 

20 Memory address generator: 

It generate the read address for the Fifo. Each address clock signal generated by the pixel counter a new 32-bit 
word F[31 :0] is sent to the pixel selector. 

25 Attribute memory and register: 

The attribute memory contain the attributes of the windows to be displayed during the current frame. The attributes 
that control the pixel selector and multiplex are: 

Display mode: bit-map, graphic, still video or empty. 
30 Number of bit per pixel or color component: 0, 1 , 2, 4 or 8 bits. 
The bit-map CLUT base address. 

The attribute register contain the attribute of the current window. The attribute clock transfers the content of 
attribute memory to the register when the window change. 

35 Window controller: 

The window controller is composed of a content addressable memory CAM, flip flop and priority encoder. The CAM 
contain the attributes of position and size of the windows to be displayed on the current frame. The figure 9 shows a 32 
words CAM. Each window require 4 words that indicate horizontally the coordinates of the first and last pixel and verti- 
go cally the coordinates of the first and last line. A 32_words CAM support 8 windows. 

The CAM compare the value of the pixel and line counters respectively X and Y. When Y counter match a value 
YnQ, a new window start vertically, the corresponding RS flip-flop is set Wn_Y=1 . When Y counter match a value Yn1 , 
the corresponding window end vertically, RS flip-flop Wn_Y is reset. The process is the same horizontally. Wn_Y and 
Wn_X are combined to indicate that the X, Y counter is into an active window. The indices "n" indicate the window 
45 number. Several windows can be overlapped, the priority encoder indicate the display order on the screen. The indices 
"n=0" correspond to the cursor that must be always on top. Outputs of priority encoder are hit and OSD_W, Hit gener- 
ates the attribute clock and OSD_W the memory attribute address corresponding to the active window. 

The details of the CAM cell is shown figure 1 0. The cell contain 2 parts, a 6 Transistors RAM cell and a 4 transistors 
comparator. The CPU load the content of the CAM with the attributes of position of the windows, memory mode is 
so selected. During the display the associative mode is selected. The line counter Y and pixel counter X are compared to 
the content of all Yn and Xn of the CAM. When X or Y is equal to one or several values the corresponding Match lines 
are active to set or reset a flip-flop. 

Example of pixel generation: 

55 

The figures 11, 12 and 13 correspond to the generation of the display and frame memory represented figures 6 and 

7. 

Figure 1 1 , the pixel Px of the window 1 is selected into the 32__bit word "m". The pixel counter is decrement by one 
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each access. Pixel selector put Px at the output Bs[0]. The current window attribute select 1_bit per pixel. The pixel mul- 
tiplex selects Base[7:1] and concatenate with Px to form the output Pixel_Mux[7:0]. In bit-map mode PixeL_Mux[7:0] 
select 2 colors of the CLUT. Base[7:1] is the base address of the CLUT. 

Figure 1 2 shows the generation of a pixel Px for the window 2 that use 4_bits per pixel in bit-map mode. Pixel selec- 

s tor put Px at the output Bs[3:0]. The pixel multiplex selects Base[7:4] and concatenate with Bs[3:0] to form the output 
Pixel_Mux[7:0] that select one of the 16 colors of the CLUT. Base[7:4] is the base address of the CLUT. 16 CLUT of 16 
colors can be selected with the window attributes. 

Figure 13 shows a specific case of the window 2 where Pn+1 has its 2 msb bits into the word m+1 and 2 Isb into 
m+2. Word m+2 is currently selected at the output of the f ifo and the 7 Isb bits of word m+1 are maintained into the 7_bit 

10 register F-1 [6:0]. Pixel selector take F-1 [1 :0] concatenated with F[31 :30] to generate Bs[3:0]. The corresponding timing 
is shown figure 14b. At Pn+1 pixel counter equal 30. The barrel shifter output generate F-1 [5:0] concatenated with 
F[31 :30]. The current f ifo address is word m+2 and the Pixel_Mux output is Base[7:4] & F-1 [1 :0] & F[31 :30]. Pixel Pn+2 
the pixel counter is decrement by 4, the pixel selector select the next 4_bits of word rri+2. 

15 Window transition: 

Figure 6 the window 1 is on top of window 2. The CAM of the window controller is loaded with window 1 attributes 
position on top of window 2. The window displayed on top has the lower indices. Pixel Pa is last pixel for this portion of 
window 2 into the frame memory, the next bits contain the code of color of window 1 , the first bit is Pb. During the same 
20 line window 1 end in Pc and window 2 restart in Pd. Each of this window transitions are detected by the window con- 
troller that generate the attribute clock to change the current display attribute stored in a register (see timing figure 1 4a). 
For Pa-1 and Pa the Pixel counter is decrement by 4 each pixel and after attribute clock Bp[3:0]=1 (figure 8) decrement 
the counter by 1 each pixel. 

25 Graphic and Still video modes: 

In bit-map mode the frame memory contain the code of the color, 1,2,4 or 8 bits per color depending of the 
attributes. The code of the color concatenated with the CLUT color base attribute select a color from the CLUT. The 
CLUT contain 3 color components, one component for Luma and two components for Chroma. 
30 When the current window is graphic, the CLUT is not used. Each pixel there is 3 access identical to the bit-map 
mode to extract the 3 colors components from the frame memory. There is 3 access during a pixel. 

In still video picture the CLUT is not used. Still video reduce Chroma bandwidth. Each pixel there is 2 access iden- 
tical to the bit-map mode to extract one Luma components and chroma component Cr or Cb alternately each pixel from 
the frame memory 

35 When the picture is empty the mode is bit-map with 0_bit per pixel. This mode is used to generate a window with a 
background color or a decimated motion video picture coming from the MPEG video decoder. 

The pixel selector allows to mix by hardware different mode of display. The objective of this disclosure is to protect 
the pixel selector and multiplex hardware, its control, the window controller, window attribute generation and the flow of 
data from the frame memory to the Pixel_Mux output in the different display modeis for different resolution. 
40 The frame memory contain a description of the current displayed picture. The description is done sequentially start- 
ing from the first upper left corner of a window "n" to the last lower right corner of a window "m"< Only the active windows 
need to be described, not the full screen, background color or motion video. 

The description is done pixel per pixel, the number of bit to describe one pixel can vary for each window. 
Each transition of window is indicated by the attributes of position stored into the CAM. TTie window controller select 
45 the attribute of the corresponding window in real time during display. 

The pixel selector select the number of bits corresponding to the current pixel to be displayed. 
The complementary bits to form the 8_bit pixel output are obtained by concatenation of selected data bits from the 
frame and window attribute from the attribute memory. 

When the current window is bit-map Pixel_Mux output select a color of the CLUT. The CLUT contain the 3 colors 
so component. i 

When the current window is graphic, the CLUT is not used. Each pixel there is 3 access identical to the bit-map 
mode to extract the 3 colors components from the frame memory. 

In still video picture the CLUT is not used. Each pixel there is 2 access identical to the bit-map mode to extract the 
2 colors components from the frame memory. Luma is extracted each pixel and chroma component Cr and Cb alter- 
55 nately each pixel. 

When the picture is empty the mode is bit-map with 0_bit per pixel. This mode is used to generate a window with a 
background color or a decimated motion video picture coming from the MPEG video decoder. 
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Claims 

1. An on-screen display co-processor, comprising: 

a FIFO; 

a decoder coupled to said FIFO; 

a display controller coupled to said. FIFO and decoder; 

a window controller coupled to said display controller; 

line and pixel counters coupled to said windows controller; and 

an attribute memory coupled to said display controller. 

2. A window controller, comprising: 

a content addressable memory for storing data corresponding to window position and size and for comparing 
pixel and line counter data with such data, 

at least one flip-flop coupled to said memory for indicating whether a window is active or not active, and 
a priority encoder coupled to said flip-flop for selecting the display order of any active windows. 
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